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Background of the Invention 

1 . Field of the invention 

The present invention relates generally to the field of telephone design 
and functionality. More specifically, it relates to user interfaces for telephones 
with voice-over-IP capability and telephony related services. 

2. DISCUSSION OF RELATED ART 

Many phones used today follow a key/lamp pair paradigm that offers 
users with literally hundreds of options and features. The key/lamp pair is a 
button on a phone and a corresponding LED light or lamp. This combination 
of button and LED lamp can be found on most PBX type phones used in 
offices and in various other environments outside the typical residential home. 
Typically, many phones today have at least 10 to 15 key/lamp pairs, some 
with many more, an information display area, also having corresponding keys 
for choosing menu items in the display area, and a variety of other buttons and 
controls. In short, most phones used in business or other non-residential 
settings are too complicated and the procedures for using them non-intuitive 
for many users. Although such phones offer users with many sophisticated 
and useful features, most users know how to use four or five of these features 
without having to look in a user's guide which, as a practical matter, is 
generally not done. Another problem stemming from the key/lamp pair 
paradigm is labeling the various keys with the name of the function, option, or 
speed-dial number. Despite the sophistication of today's phone, much of the 
labeling is done by printing or handwriting small labels and taping or adhering 
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them next to the appropriate button. When the function or label of a particular 
button changes, a new label needs to be made to replace the old one. This 
manual process alone is a sufficiently high hurdle to keep many people from 
fully utilizing their phones. 
5 In addition to being overly complex and cluttered with options and 

features most people rarely use, even the better designed phones provide little 
information on how to navigate through calls and other features such as 
messaging and voice mail. For example, most phones still rely on a blinking 
light to indicate messages or that a call is on hold or a red light to indicate that 

10 the " Set Busy" feature is activated. The user interface and display features 

are not commensurate with the sophistication and complexity of many phones 
today. As a result, users are not instructed on how to navigate and utilize 
many of the features via a simple and intuitive user interface. Most interfaces 
on phones today are limited to small liquid crystal display areas and numerous 

1 5 buttons and corresponding lamps. With such interfaces, for example, it is 
difficult to provide quick access to frequently used features — an important 
characteristic of any user interface. Furthermore, given the shortcomings of 
many user interfaces on phones today, it is unlikely they can provide non- 
telephonic information to a user. Presently, phones are under utilized in that 

20 they are capable of providing in-depth data on messaging, phone directories, 
and third-party data. 

Therefore, it would be desirable to have a highly functional phone with 
a graphical display area capable of showing a rich depth of information on a 
screen for the user to see at any given time. It would be desirable to have a 

25 user interface in which buttons and keys are context-sensitive thereby 

reducing the number of mostly unused buttons on the phone. It would also be 
desirable to have a user interface familiar to users such as a window or plane- 
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oriented interface for presenting information in an easily comprehensible and 
intuitive manner. It would also be desirable to give users on-demand access to 
context-sensitive " Help" information on functions and options available on 
the phone at anytime, thereby enabling users to take advantage of features and 
functions on the phone. 
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Summary of the Invention 



According to the present invention, methods, data structures, and 
computer-readable media for processing input to a telephone having an 
interactive user interface are disclosed. A telephone user inputs commands 
through buttons and keys on an interactive user interface. The user interface 
allows a user to easily use basic and advanced telephony functions, telephony- 
related services, such as accessing phone directories and voice mail, and non- 
telephony services. A user can enter commands and various input through the 
use of mode buttons, such as an Information/Help button or Messages button, 
or tlirough keys, namely soft keys and line keys. The non-telephony services 
can include any information deliverable over, for example, TCP/IP or DHCP, 
and can include information such as stock prices, weather, sports data, and so 
on, typically from third-party services. It can also include intra-company 
information such as meeting schedules, conference room bookings, cafeteria 
menus, and so on. The interactive user interface allows a user to intuitively 
and efficiently navigate through all telephonic and non-telephonic services 
using menus and scroll bars. A user can also pull up context-sensitive "help" 
information on the display at any time to learn more about a particular mode, 
option, or feature. 

In one aspect of the present invention, a method for processing a 
selection made from a menu on the telephone having a display monitor and 
the ability to display one of numerous modes is described. A selection made 
from a menu on the telephone is detected. The menu can be a collection of 
options, features or commands corresponding to physical context-sensitive 
soft keys or a line keys. A message based on the menu selection is created 
and passed to a menu processing object. If a soft key is pressed, the menu 
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processing object is a soft key processing object. An event based on the menu 
selection is also created. It is then determined which mode from the numerous 
modes available on the phone is presently active or has focus. Once the active 
mode that presently has focus is determined, an appropriate menu label set and 
segment display is displayed on the display monitor. 

In another aspect of the present invention, a method for displaying a 
soft key label set on the display monitor of a telephone is described. The soft 
key label set is a set of text strings describing features, options, and 
commands, that correspond to two or more physical keys or buttons on the 
telephone. In cases where these keys correspond to different text strings 
depending on the context (i.e., what the user is doing or viewing at a particular 
time), the keys are referred to as soft keys. A collection of soft key text label 
sets are stored in a manner in which they can be easily retrieved and displayed 
on the phone monitor. A soft key label set is retrieved using an index. The 
value of the index is determined based on a particular context. That is, which 
soft key label set is displayed is determined by what the user is doing on the 
phone. In some contexts, some of the labels in a particular soft key set may 
not be applicable. In these cases, the inapplicable text strings are invalidated 
using a valid mask. The valid mask is also determined by the index used to 
retrieve the soft key label. Each text string in the soft key label set is 
displayed on the telephone monitor such that the text strings correspond to a 
physical button on the telephone. 



Attorney Docket No. CISCPIIS/JEA/RN 



5 



Patent 



Brief Description of the Drawings 



The invention will be better understood by reference to the following 

description taken in conjunction with the accompanying drawings in which: 

FIG. 1 A is a screen shot of an overview window of the present 
invention. 

FIG. IB is a photographic illustration of a phone equipped with a 
monitor and keys for using the interactive design user interface of the present 
invention. 

FIG. IC is a screen shot showing a configuration of a call window of 
the present invention. 

FIG. ID is a screen shot showing another configuration of an overview 
state of the present invention. 

FIG. 2 is a screen shot of an overview state in accordance with one 
embodiment of the present invention. 

FIGS. 3A to 3C are screen shots of overview windows when an 
incoming call is received in the present invention. 

FIGS. 4 A to 4F are screen shots of Directories windows configuration 
of the present invention. 

FIGS. 5 A to 5C are screen shots of Messages windows configuration 
of the present invention. 

FIGS. 6A and 6B are screen shots of Services window configurations 
of the present invention. 

FIGS. 7 A to 71 are screen shots of Settings window configurations of 
the present invention. 

FIG. 8 is a screen shot of an Information window configuration of the 
present invention. 
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FIG. 9 is an illustration showing various display planes on the phone 
in accordance witli one embodiment of the present invention. 

FIG. 10 is a detailed illustration of a line plane of the phone in 
accordance with one embodiment of the present invention. 

FIG. 1 1 is a block diagram showing a relationship among various 
objects and active sets of soft keys for use on a phone in accordance with one 
embodiment of the present invention. 

FIG. 12 is an overview flow diagram of a process for retrieving and 
displaying an appropriate soft key set on the phone in the described 
embodiment. 
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Detailed Description 



Reference will now be made in detail to a preferred embodiment of the 
invention. An example of the preferred embodiment is illustrated in the 
accompanying drawings. While the invention will be described in conjunction 
with a preferred embodiment, it will be understood that it is not intended to 
limit the invention to one preferred embodiment. To the contrary, it is 
intended to cover alternatives, modifications, and equivalents as may be 
included within the spirit and scope of the invention as defined by the 
appended claims. 

In accordance with one embodiment of the present invention, there is 
provided a voice-over-IP network phone having an overlapping 
segment/window type user interface as described in the various figures. The 
user interface of the phone of the present invention strikes a balance between 
traditional PBX phones and new information delivery and management 
capabilities afforded by voice-over-IP technology. Information regarding call 
line management, directories, messaging, phone settings, and third-party 
information services is effectively displayed in a windows-oriented display 
area. Features available on the phone are accessible by soft keys or hard keys 
based on frequency of use and the immediacy in which they are typically 
accessed. Given the IP nature of the information delivery to such phones, 
third-party software developers have incentive for developing software for 
delivering information to such phones. In addition, with context-sensitive soft 
keys, it is possible to provide context-specific guidance and information for a 
particular feature. Before describing the object-based implementation of the 
phone features and modes, the interactive user display and physical key layout 
is described. 
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The interactive design user interface of the present invention presents 
one of several modes of use to a user at any given time. These modes include, 
but are not limited to, Overview, Directories, Messages, Services, and 
Settings. The default mode or statd is Overview. The initial screen 
5 configuration is the first screen shot of the user interface a user normally sees 
when using a phone ("set") equipped with the present invention. In the 
described embodiment, in the idle state users have visual access to each of the 
directory numbers or lines assigned to their set. When a call comes in to any 
one of these lines, a call plane or window, described in greater detail below, 

10 occupies a large portion of the screen, leaving only the last four digits of the 
directory number visible. As will be described fiarther below, the user 
interface of the present invention has several planes, segments, or frames 
including, such as the call plane and a header plane. Although the term plane 
is used in the described embodiment, the term refers to any type of portion, 

1 5 area, or segment on the screen that contains information viewable by a user. 
An example of the overview screen shot is shown in FIG. 1 A. At the top of 
the screen is a header plane/bar 102 that includes information such as time, 
date, and the primary directory number of the set. To the right of the primary 
number is a space 1 04 for an icon to denote the current state of the telephone 

20 line. 

In a line plane area 106 is a list of other direct lines available to the 
user. A particular line, including the primary direct line in header bar 102, can 
be selected by pressing a line key, described in FIG. 1 B below, on the set that 
corresponds to {i.e., is physically across from) the line desired,"such as 778- 
25 8 1 9 1 . At the bottom of the screen is a command selection area 1 08, also 

referred to as a soft key plane. In the described embodiment, there can be up 
to four commands in one menu. If more commands are desired, one command 
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is reserved for " more," which when selected takes the user to another menu of 
commands. A command can be selected by pressing a corresponding " soft 
key" on the set directly below the command, as shown in FIG. IB. In FIG. 
1 A there are tliree commands shoWn, two of which can be used in the 
overview state: Redial and NewCall, indicated by darker lettering compared to 
the grayed-out lettering of the presently inactive command PickUp. The 
screen portion directly above soft key plane 108 that contains the text "Your 
current options" is a status/prompt plane 110 that can have several roles in the 
described embodiment. In the overview mode, it prompts a statement relating 
to the soft keys. In other screen shots it can provide update information as to 
what the set is presently performing, such as dialing a number or searching for 
a name. 

FIG. IB is a photographic illustration of a phone equipped with a 
monitor and keys for using the interactive design user interface of the present 
invention. The user interface is displayed on a screen 1 12 on monitor 113. 
On the right side of screen 1 12 is a series of line keys or buttons 1 14 (each of 
which can be physically depressed) used to highlight or select a corresponding 
item, such as a number or name on screen 112. Each line key opens or closes 
a window or plane with information about a corresponding feature or item on 
screen 1 1 2, such as the name of the person being called. When applicable it 
can act as a speed dial key for a corresponding item (name or phone number) 
shown on screen 112. 

Directly below screen 1 12 is a series of soft keys 1 16 used to activate 
corresponding commands or options shown on the screen in soft key plane 
108. Soft keys are used to select an item from a menu (or a single selection) 
displayed in soft key plane 108. Also on the set is a group of keys 1 18 for 
activating some of the various other states or modes. They include buttons for 
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Messages, Directory, Services, Settings, and Information ("i"). When 
pressed, a user can enter and exit a particular mode, as described in greater 
detail below. Also on the set are scrolling or "up/down" keys 120 for 
scrolling through pages on screen 1 12. The other keys are typical telephony 
5 keys including an alphanumeric key pad 122, volume buttons 124, and 
Headset, Mute, and Speaker buttons 126. 

Before describing the commands available from the overview state as 
shown in FIG. 1 A, an overview window is described. FIG. 2 is a screen shot 
of an overview state in accordance with one embodiment of the present 
10 invention. In an overview window 201 line activity is signaled by minimal 
4= caller identification such as text string 202 and a line status icon 204 

CI appearing to the right of the directory number. To get more detailed 

41 information on a call, a call window is invoked. An example of a call window 

E is shown in FIG. IC. FIG. IC is a screen shot showing an example of a call 

ui 15 window. Call window plane 129 is a call window for line 8125. A command 

L EndCall 128 is available to the user in this configuration, as well as the Redial 

command. FIG. ID is a screen shot showing another configuration of on 
overview state. A command CFwdAlI 130 is available to the user in this 
configuration. In other preferred embodiments the other commands or options 
20 can be displayed in the various screen shots in the Idle state. 

FIGS. 3A, 3B, and 3C are screen shots of a call window. Call 
windows provide more detailed information related to a call than the single 
line of information presented in the Overview state shown in FIG. 2. For 
example, a call window permits the display of information related to multiple 
25 simultaneous calls on the same primary directory number. In the described 
embodiment, when an incoming call is received by a set in the overview ■ 
mode, a call window, such as plane 303 in FIG. 3 A appears. For subsequent 
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calls on a different directory number, the user selects that line (using a line 
key) to display a corresponding call window. 

An icon 302 indicating the status of the phone call appears on the left 
representing the status of calls on a'particular line. In addition, more complete 
information, such as the fiill name of the caller is displayed. Prompt/status 
plane 1 10, described initially in FIG. 1 A, displays the status of the highlighted 
call (a particular call on the line) in line 304 containing the name "Franklin 
Eleganza." Another line 306 contains the name of an incoming call. Other 
examples of call windows are shown in FIGS. 3B and 3C. The screen shot in 
FIG. 3B shows a call window 308 containing a telephone number. In the 
command selection area is one available command for EndCall. FIG. 3C is a 
screen shot of a call window 309 with various options available to the user. 
The call window itself is similar to call window 303 shown in FIG. 3A, except 
the screen also has displayed some of the commands available to the user and 
are associated with or attached to the selected (highlighted) line or call: Hold, 
Trnsfr, and EndCall. In other preferred embodiments, the call windows 
described can contain additional or fewer commands and options than those 
described depending on user needs. 

As mentioned above, there are various modes available to a user that 
can be chosen using buttons 1 18 in FIG. IB. One mode available to a user is 
the Directories mode. In the described embodiment, this mode can be 
accessed by pressing the "Directory" button from key group 1 18 on the set 
equipped with the interactive design user interface of the present invention 
(the mode can be closed by pressing the same Directory button). FIG. 4A is a 
screen shot of an initial Directories mode screen. Each mode plane or window 
is identified by an icon 402 and a title 404 identifying the mode (e.g. 
Directories, Services, Settings, etc.) appearing in a line below the header 
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plane. A mode plane 406 displays a list of categories from which a user can 
make a selection, highlighted in light gray, such as Redial List 408. Also 
shown are two commands or options: Select 410 and Search 412, either of 
which can be selected using a corresponding soft key. A user can also see 
5 other options by pressing the soft key under the "more" button 410 on the far 
right. 

FIG. 4B is a screen shot of a Search configuration when chosen from 
the Directories mode in accordance with one embodiment of the present 
invention. A user input screen appears requesting one or more items of 

Ci 10 information from the user needed to perform a search for a name or number. 

41 In the described embodiment, the search criteria presented to the user are 

Q " First Name" " Last Name" "Number" and " Other." The user can enter 

0) 

J; information into one or more of these fields using line keys 114 and key pad 

^ 122 on the set. To begin the search the user presses the soft key 

r: 1 5 corresponding to Begin and can cancel the operation by pressing the soft key 

r[ corresponding to Cancel. If a particular entry matches the search criteria, it is 

displayed on the screen in a manner similar to that shown in FIG. 4C. 

FIG. 4C is a screen shot of the Directories mode when a user selects a 
particular category. In this case, the user selects and opens the Business 
20 category from FIG. 4A. In this screen shot, a partial listing of the user's 
business contact names and numbers are displayed. In the described 
embodiment, the options available to the user are Dial, Search, and Back. The 
Dial option dials a highlighted entry, such as Atypical Networks highlighted 
in light gray. The Search option is identical to the Search feature shown in 
25 FIG. 4A. The Back option allows a user to go back to the Directory list 
shown in FIG. 4A. 
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FIG. 4D is a screen shot of another configuration in the Directories 
mode. This configuration displays additional options to the user. In the 
described embodiment, they include Edit, Delete, and New. These options are 
displayed if the "more" option is Selected in the previous menu shown in FIG. 
4A and can be chosen from either the primary Directories screen showing 
categories of phone numbers or from a particular category hsting such as 
shown in FIG. 4C. In a preferred embodiment, the Edit option allows a user 
to edit the name of a selected directory category, such as Redial List, or to edit 
the details of a selected contact, such as Atypical Networks, if in that screen. 
Similarly, in a preferred embodiment. Delete allows a user to delete an entire 
highlighted Directory category or delete a selected contact or name (along 
with any other related information, such as phone number). Finally, New 
allows a user to create a new Directory category or create a new name in a 
particular category if already in a particular category in a preferred 
embodiment. 

If the " more" option is selected, the user is presented with two 
remaining options in the described embodiment. If "more" is selected from 
the main Directories menu shown in FIG. 4A, a screen shot shown in FIG. 4E 
displaying the options Copy and Paste appears. If "more" is selected from a 
specific directory listing, such as shown in FIG. 4C, the same two options are 
displayed as shown in FIG. 4F. As with the Edit, Delete, and New commands, 
the functions of the Copy and Paste commands are the same in both settings 
but the data they operate on is different. By selecting Copy in FIG. 4E, a user 
can copy a highlighted directory into memory. By selecting Copy in FIG. 4F, 
a user can copy a highlighted name, such as Atypical Networks, into memory. 
By selecting Paste in FIG. 4E, a user can paste an appropriate item from ' 
memory into a highlighted directory. By selecting Paste in FIG. 4F, a user can 
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paste from memory cm appropriate item into the directory the user is currently 
in. It is possible to have some directories or folders that a user cannot or is not 
allowed to edit, such as a corporate directory. In such a case, the add, delete, 
and paste options are not available: 

Another mode a user can access is the Messages mode by pressing the 
"Messages" button in key group 1 18 on the set. In the described 
embodiment, pressing the Messages button displays the screen shot shown in 
FIG. 5A. FIG. 5A is a screen shot of an initial Messages mode configuration 
in accordance with one embodiment of the present invention. As with the 
Directories mode, it shows an icon 502 and a Messages title 504. Undemeath 
the title is a listing of the number of new messages and old messages. In the 
screen shot of FIG. 5 A, the user has one new message and two old or played 
messages. In the status area the user has the option of accessing the user's 
voice mail. By selecting Yes, the user's voice mail number is dialed. FIG. 5B 
is a screen shot showing the activation of voice mail. Once voice mail is 
accessed, the user sees the voice mail number 502 being dialed, also shown 
graphically tlirough icon 504. At this stage, in a preferred embodiment, the 
user can select from the command EndCall, in addition to commands Hold 
and Trnsfr (although these commands may not be applicable in all voice mail 
implementations), all applying specifically to the call being made to the user's 
voice mail. 

FIG. 5C is a screen shot of a partial listing of new and old messages. 
A highlighted entry 506 has an associated icon 508 indicating that the 
message is new or unopened, and displays the name of the caller and the time 
and day when the message was left. The other entries have an icon 510 
indicating that the messages are old along with similar information about the 
message. In the described embodiment, the options available to the user for a 
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selected message are Play, Forwrd, and Delete. The Play option allows a user 
to listen to the highlighted message. The Forwrd option allows a user to 
forward the message to another user. The Delete option allows the user to 
simply delete the message from the user's voice mailbox. In other preferred 
embodiments, fewer or additional commands can be displayed and other 
information about messages can be available to the user. 

FIG. 6A is a screen shot of an initial Services window configuration in 
accordance with one embodiment of the present invention. As with all screen 
shots described above, at the top of the screen is a header plane 102 indicating 
the time, date, and the primary direct line assigned to the set. In addition to 
this information, the Services mode provides the user with access to various 
non-telephonic information. As with the modes described above, the Services 
mode can be invoked by pressing the Services button on the set. The mode is 
indicated by a Services icon 602 and Services title 604 in row 606 below 
header row 102. Once in the Services mode, a user can exit by pressing the 
Services button. Underneath row 606 is a listing of categories of information 
to which the user has access. In the described embodiment there are three 
categories of information: Stock/Weather Report, Meeting Schedule, and 
Cafeteria Menu. In other preferred embodiments, there can be more or fewer 
categories of data depending on needs of the users being serviced and physical 
limitations of the set, for example network connections and bandwidth. 

The user can highlight a particular category by pressing a 
corresponding line key and then select it by pressing the soft key directly 
below Select. In FIG. 6A the Stock/Weather Report category is highlighted. 
If selected, a screen shot shown in FIG. 6B appears. In the described 
embodiment window 608 displays the current temperature in a particular area, 
such as San Francisco cind other weather information, in this case, a five-day 
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forecast. Displayed in a row 610 is stock market information; in this case, the 
Dow Jones Industrial Average and, by scrolling to the right (using scroll keys 
120), the NASDAQ index value. In other preferred embodiments, other types 
of weather and stock market information, such as the price of certain stocks, 
can be displayed if the necessary network connections and other requirements 
are met. In the described embodiment, other options are available and the user 
can return to the screen shot of FIG. 6A by pressing the soft key 
corresponding to " Done." 

Another mode in the described embodiment is the Settings mode 
which can be invoked by pressing the " Settings" key in key group 1 18. FIG. 
7A is a screen shot of an initial Settings mode configuration in accordance 
with one embodiment of the present invention, A Settings mode icon 702 and 
title 704 are displayed in row 706. Underneath row 706 is a list of features 
and options available to the user in the described embodiment. These include 
Contrast, Ring Type, Hunting, Call Forward, and Network Configuration. 
The user can highlight a feature, such as Contrast in FIG. 7A, and select it by 
pressing the soft key. FIG. 7B is a screen shot of a Contrast setting display in 
the described embodiment. A graphical contrast setting bar 708 is displayed 
in window 710. In the command selection area, the user can increase or 
decrease the contrast of the screen display (for all modes) or return to the 
initial Settings screen. 

FIG. 7C is a screen shot of a Ring Type setting display in a preferred 
embodiment. The user can highlight and select a particular telephone ring 
type from a selection including High, Low, and Warble. In this setting, as 
with the Contrast setting and the settings described below, other options and 
selections can be provided depending on the needs of the users and 
capabilities of the set, telephone system, and network capabilities. The 
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options shown are illustrative of a particular configuration. The configuration 
can be modified while remaining within the general concepts, modes of use, 
and menu hierarchies of the interactive design user interface of the present 
invention. For example, in another preferred embodiment, a longer list of ring 
types having a more descriptive names can be displayed to the user. Such 
different ring types may be implemented by ,wav files. 

FIG. 7D is a screen shot of a Hunting feature display in a preferred 
embodiment. As explained in text 712, this feature of a preferred embodiment 
allows incoming calls to be redirected to a certain number when the set is 
busy. In other preferred embodiments, this feature and related features 
described below up to FIG. 7H, may not be desirable and, thus, not available 
to a typical user of the phone. Whether these features should be available to a 
user can be determined by a system administrator. It should be noted that 
these features allows a user to put his phone in a state in which he cannot 
receive any calls, typically an administrator function. In many cases this may 
not be desirable. However, when available, the feature can be set by editing 
the options, such as the phone number or extension to which the calls should 
be redirected, using Edit command 714. FIG. 7E is a screen shot of a Call 
Forward feature display in a preferred embodiment. Shown are three options: 
All Calls, No Answer, and Internal. A user can highlight and select an option 
using the line keys and soft keys as described above. FIGS. 7F, 7G, and 7H 
are screen shots of the tliree options. The screen shot in FIG. 7F is displayed 
if the Internal option is selected from FIG. 7E. It allows a user to forward all 
internal calls to a particular number. The user turns the feature On or Off, or 
can edit the option, using the command options and soft keys as described 
above. The screen shot in FIG. 7G is displayed if the No Answer option is 
chosen. This feature allows a user to forward calls to a particular number if an 
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incoming call is not answered within a certain number of rings. As with the 
Internal option, the user can turn the option On or Off, or Edit the contents, 
such as the number of rings or the forwarding number, using the command 
options and soft keys. A third option in the described embodiment is the All 
Calls option, the screen shot for which is shown in FIG. 7H. This option 
allows a user to forward all calls (internal and external) to a particular number. 

Anotiier Settings option that can be selected from the screen in FIG, 
7A is Network Configuration. FIG. 71 is a screen shot of a Network 
Configuration option display in the described embodiment. In a window 716 
are displayed numerous informational items related to the network. These 
include the set's IP address and the company's Domain name. It also 
indicates whether the DHCP option is On or Off In other preferred 
embodiments, other information related to the network can be included on 
additional pages if necessary. 

FIG. 8 is a screen shot of an Information window in accordance with 
one embodiment of the present invention. This mode provides context- 
specific information on a peirticular function, option, or command in a selected 
mode. First, the information window is activated at any time by pressing the 
" i" button in the center of key group 11 8 on the set followed by the key for 
the mode in which the user desires more information. This step can be 
skipped if the user is currently in the mode. The information key can then be 
used to explain a particular feature or command on demand. The example 
shown in FIG. 8 is information regarding the feature Call Forward All Calls. 
An icon 802 and Information title 804 indicate that the user is in Information 
mode. An arrowhead 806 denotes that there is more information on a 
subsequent page. The user can go to these pages by using scroll keys 120 on 
the set. 
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The screen shots described above represent the interactive user 
interface displayed on a monitor connected to or part of a telephone with the 
necessary network connections. The user interface allows a user to navigate 
through the various functions, options, and features available on PBX phones 
and phones equipped with voice-over-IP technology. The user interface is 
implemented using underlying software and data objects functioning in 
cormection with or directly on the telephone. As described above, among the 
various actions a user can take, one is either pressing a context-sensitive soft 
key 1 16 to select an option or feature, or pressing a line key 1 14 as shown in 
FIG. IB. Another action a user can take is pressing one of the mode keys 1 1 8 
to access one of the operation modes or to access help information. Any of 
these actions cause the underlying software to retrieve and display certain 
information tliiough the interactive user interface. 

FIG. 9 is an illustration showing various display planes used in the 
interactive user interface of the phone in accordance with one embodiment of 
the present invention. As described above, screen 1 12 of the user interface on 
the phone has numerous components or planes. In the described embodiment, 
these planes are implemented logically as a hierarchy or series of layers, 
wherein each layer is an object (thus, a hierarchy of objects). These objects 
reside on and are under the control of the phone. In one preferred 
embodiment, the objects are implemented on an ASIC chip on the phone. A 
top layer 902 is header plane 102 which displays header information such as 
current time, date, and the primary extension number assigned to the phone. 
The header plane is always displayed in a preferred embodiment. It orients 
the user to the identity of the set. On the right is space for an icon denoting 
the current state of the set. Another layer 904 represents prompt/status plane 
1 10 on the phone. The prompt/status plane updates the user as to what state 
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the phone is in or prompts a statement relating to the soft keys. Any prompt 
messages that need to be displayed to prompt the user into some type of action 
overrides any status messages in the described embodiment. In the described 
embodiment, there is typically one prompt message for each mode and several 
status strings for each mode. When a line plane has focus (described in 
greater detail below), status and prompt messages displayed relate to a 
selected line or call. The content displayed in the prompt/status plane depends 
on which mode presently has focus. Below layer 904 is a layer 906 
representing a soft key plane displaying labels for each of the soft keys which 
typically changes in different contexts. Layers 902, 904, and 906 are all one- 
dimensional in the described embodiment. At the bottom of the hierarchy is a 
three-dimensional layer 908 representing line plane 106 that displays 
information on the numerous phone lines available on the phone. 

FIG. 10 is a detailed illustration of layer 908 of FIG. 9 representing a 
line plane of the phone in accordance with one embodiment of the present 
invention. The line plane of the phone display area can be viewed as a three- 
dimensional plane having numerous levels or layers and resides on the phone 
in the described embodiment. At one end of the hierarchy is an overview 
plane 1002 showing an overview of ail calls on the phone. Typically there are 
one or two active calls shown in overview plane 1002. At the next layer is a 
line detail plane 1 004 which shows detailed data on one call on a particular 
line, such as the full name and/or phone number of the caller. At the next 
layer is a mode plane 1006. Mode plane 1006 displays data relevant to one of 
the four modes in the described embodiment. They include Settings, 
Directories, Services, and Messages. Data related to one of these modes is 
displayed in the mode plane when the user invokes a mode by pressing a ; 
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button from buttons 118 of FIG. IB on the phone. These modes share the 
same layer 1 002 and only one can be active at a time. 

At the other end of the line plane hierarchy is an information layer 
1008 which overlays any of the other planes 1002, 1004 or 1006. 
Information/help plane 1 008 overlaps all other planes when invoked by a user 
when the information button ("i") on the phone is pressed at any time. 
Information on a particular mode or call is available in any context regardless 
of which plane is active. Each of the planes or objects 1002, 1004, 1006, and 
1008 has associated data and states, and can be invoked by using an active 
message to open the object. Upon receiving this type of message, the plane or 
object activates itself and causes itself to open. Once the object is active, it 
gets messages first and sends messages to a line handler object which resides 
on the phone. At this stage the open object has control of the soft keys, 
alphanumeric keys, the scroll keys, and other input means on the phone. 
When the plane or object is active or open, that object (i.e., mode) has focus in 
the phone. Once the object is deactivated, it no longer has focus of the phone. 

FIG. 1 1 is a block diagram showing a relationship among various 
objects and active sets of soft keys for use on a phone in accordance with one 
embodiment of the present invention. The soft keys on the phone have 
context-specific functions. Thus, depending on the context, different text 
labels corresponding to the underlying functions are displayed above each soft 
key. For example the first soft key on the left side in FIG. IC is Redial, but in 
another context, such as in FIG. ID, it is CFwdAll (forward all calls). A 
context can have a set of options or choices for a user. Those options are 
made available through the use of soft keys. In the phone of the present 
invention, there are four soft key buttons. However, the options available to a 
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user can exceed four by having one of the buttons correspond to "more" 
indicating that there are other options available. 

Each active set of soft key labels is stored in storage area 1 105 as a 
collection of soft key sets 1 102. A particular set of soft key labels, such as set 
5 1 103, is retrieved via a soft key index 1 104 using a number that points to the 
correct soft key set in storage area 11 05. Connected to index 1 104 is a valid 
mask 1106 which enables a " graying out" of certain options in an active set of 
soft keys which do not apply in a particular instance even though the soft key 
set may be correct in the larger context. In these cases, the options are still 
Hi 10 visible to the user even though they may not apply but are differentiated by 

U-i 

being grayed out. In other embodiments, other visual indications can be used 

ttl 

to differentiate these options. This is desirable over having a greater 
4] proliferation of soft key sets for every possible configuration in every context. 

l_ It is also preferable from a user standpoint to have the same soft keys appear 

15 to be rooted in the same position when possible. This can be achieved by 

using the same soft key sets and simply invalidating specific options that do 

CI 

Ci not apply in a particular context. If a user presses a soft key that is "grayed 

out" the action is ignored and no event is created. Soft key index 1 104 and 
valid mask 1 106 are invoked by either line plane 106 or a call plane 309. 

20 With call plane 309, remotely stored soft key sets may be accessed using soft 
key index 1 104. These remote soft key sets can be downloaded from a call 
manager module located on a separate server. 

FIG. 12 is an overview flow diagram of a process for retrieving and 
displaying an appropriate soft key set on the phone in the described 

25 embodiment. At a step 1202 a line handler object detects that a particular soft 
key was pressed. This message is passed to the phone and a call meinager 
program. At a step 1204, the line handler object passes responsibility for the 
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message or action to a soft key object. The soft key object creates an event 
based on the key/option pressed by the user. By way of comparison, an event 
is created by the line handler object when a line key is pressed, the handset is 
picked up, or the speakerphone is activated. 
5 As described earUer, the soft keys are context-sensitive in that the 

options corresponding to the soft keys change according to actions taken by 
the user. The soft key object is responsible for retrieving the correct soft key 
labels and displaying them as needed (e.g. some may be in reverse video or 
grayed out). At any given time, a particular object in the system has control or 
1 0 " focus" of the phone. Before the event can be processed by the soft key 
4^ object, the system must determine which object presently has focus. This is 

Q done by the processing of the messages. The line handler object detects that a 

4= particular mode key has been pressed, such as the Messages key or the 

s Settings key. As described above, the appropriate mode or object then has 

15 focus by being sent an active message and being opened. In the described 
Li embodiment, this is implemented by using a database variable in a database 

?l indicating which object has focus. The variable is an array index which points 

to a mode object, active line, or line handler object. This is done at a step 
1206. 

20 If the line plane is active, a call manager presently has focus. The call 

manager has focus when none of the other planes or objects have focus. In the 
described embodiment, the other objects are Messages, Directory, Settings, 
Services, and Information. If the call manager processes the soft key event, 
control goes to a step 1208 where a call manager program, typically located on 

25 an external server, such as a Windows NT server, handles the event. The call 
manager then sends a stimulus message to the line handler object. This : 
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stimulus message causes the phone to display a call plane, change the soft 
keys, or create a dial tone if needed. 

If any of the five other objects or modes have focus, control goes to a 
step 1210. If the user has any of the five services (including the Help feature) 
active and a call conies in, the call manager located on an external server still 
contacts the line handler object. This occurs because a user still typically 
wants the phone to ring when a call comes in. At step 1210 the system 
retrieves the appropriate soft key label set and overlays the appropriate plane 
in the line plane area of the display. In the described embodiment, when the 
line plane changes, a "wiper" comes across the display area. During this 
animation, the soft keys are grayed out (for typically % to Vi second) so that 
the user cannot use those keys. When the plane is displayed and the animation 
is complete, the key labels are displayed in an active state. This prevents 
invalid events from occurring from having a user press soft keys before the 
system is ready to process the event. 

At a step 1212, the new object (one of Messages, Directory, Services, 
and Settings, or Information) has focus and the appropriate soft key labels are 
displayed. Thus, soft keys are changed by local events or by a call manager 
program and can change at anytime. However, only the object having focus 
can change the soft keys labels. Control then returns to step 1202 where the 
system is ready to detect another soft key event by the user. 

When the call manager sends a stimulus message to the line handler 
object, as described in step 1208, such as when a call is being made or 
received, one of numerous line handler object messages is activated. Below is 
a list of the line handler object messages, a description of each one, and the 
typical parameters needed by each one. 
Call Information 
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The call manager ("CM") sends a call information message to the line 
handler object when a new call lands on a Directory Number Line. The 
parameters include the Calling Party, Called Party and the Original Called 
Party. The Original Called party information will only be provided for calls 
that have been forwarded. The Line Instance number and the Call Reference 
ID are sent so the Line Handler object knows which Line to place a call on. A 
call type indicator is given in order to distinguish what type of call is being 
presented. 



Parameter 


Description 


Callmg Party Number 


The directory number oi the calling party 


Callmg Party Name 


1 he name ot the calling party. Ihis tield is optional. 


Called Party Number 


I he directory number otthe called party. 


Called Party Name 


I he name ot the called party. 1 his tield is optional. 


Origmal Called l^arty 
Number 


1 he directory number ot the called party. 1 his tield is only valid 
on forwarded calls. 


Original Callmg Party 
Name 


1 he name ot the called party. I his tield is optional and is only 
valid on forwarded calls. 


Line Instance Number 


1 his line indicates which DN line that this call is on. 


Call Keterence ID 


This is the Call Keterence Number tor the call, it is used to 
differentiate between multiple calls and a DN line. 


Call I'ype 


1 his distinguishes the type ot call, choices are (INBOUND, 
OUTBOUND, and FORWARD). 



Call State 



The CM sends this message when an existing active call changes state. 
Examples of events that cause call state changes are far end answering, near 
end hang up, and the hold button being pressed. The phone does not process 
call states locally, but rather uses the call state information to determine what 
to display in the line plane and call display plane. All active calls must receive 
a CLEAR call state message when the call clears, which causes the call to be 
removed from the display. 



Parameter 


Description 


Call estate 


1 his mdicates the current state ot the call, choices are (KINO IN, 
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WNG OU r, BUSY, CONGES'l'lONS, INVALID NUMBER, 
TALK, HOLD, and CLEAR). 


Call Reterence ID 


1 his IS the Call Reterence Number tor the call, it is used to 
differentiate between multiple calls and a DN line. 



Call Select Request 

The CM sends this message to the line handler object when it needs to 

know which call in the line plane the user has selected for functions such as 

Pickup and Join. The phone responds with the Line Instance number and Call 

Reference ID for the selected call. This message has no parameters. 

Download Soft Key Templates 

The CM sends this message when it wants to create or change one or 

more soft key templates. Typically this is only done when the phone registers 

with CM, but it could be done at any time. If more than 32 soft keys exist, 

then multiple messages must be sent with the appropriate index. 



Parameter 


Description 


Sott Key t emplate 
Offset 


1 his IS the index mto the Sott Key t emplate Array (1 to 236). 


Sott Key 1 emplate 
Count 


1 his IS the number ot sott keys contained in this message (1 to 32). 


Sott Key i+O 1 est 


1 he text label tor sott key number "index". 


Sott Key i+O Button 
Definition 


1 he button event type that the phone originates when this sott key 
is pressed. 


Sott Key i+l i ext 


the test label tor sott key number "index+l". 


Soft Key i+l 
Button Definition 


1 he button event type that the phone originates when this sott key 
is pressed. 


* * s(i 




Sott Key 1+31 Text 


1 he test label tor sott key number "index+3 T' 


Sott Key i+31 
Button Definition 


1 he button event type that the phone originates when this sott key 
is pressed. 



Download Soft Key Sets : 

The CM sends this message when it wants to create or/change one or 

more soft key sets. As described with respect to FIG. 1 1, a soft key set such 

as those in 1 102 is a set of defined soft keys that are available at any given 

point in time. Typically these sets are only downloaded when the phone 
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registers with CM, but this could be done at any time. Each soft key consists 
of 16 soft key templates. The first member of the array of indexes is 
associated with the first soft key position, and so on. Undefined soft key 
positions, which aie indicated by ^ soft key template index of zero, are left 
blank on the display. 



Parameter 


Description 


bott ICey set Uttset 


1 his is the index into the Sott Key Set array (1 to 256) 


Sott Key set Count 


I his is the number ot the soft key sets contamed in this message 
(1 to 32) 


Soft Key Set 1 


Array ot 16 sott key indexes tor set 1 


Soft Key Set 2 


Array ot 16 sott key indexes tor set 2 


* * * 




Soft Key Set 32 


Array ot 16 sott key indexes tor set 32 



Select Soft Keys 

The CM sends this message when the context of a plane has changed, 
such as when a new call is received. This causes the designated line plane to 
change its soft key mapping. Each active call within each call plane has a set 
of soft keys associated with it. This set has a number of soft keys, which may 
be defined, but may be invaHd for the current call state. The plane specified by 
the instance number "0" indicates the line plane and 1 through 26 indicates 
one of the call planes. 



Parameter 


Description 


Instance Number 


1 his indicates which Line/Call plane tor which we are 
changing key mapping. 


Call Reference Number 


1 his indicates which call within the Call plane tor which we 
are changing key mapping. 


Soft Key Set Index 


1 his IS the index ot the new SSoftivey tSet (U to 2!>!>) 


Valid Key Mask 


1 his IS a 16-bit mask ot all the sott keys that are valid at the 
time that this message is sent. 



Display Status 

This message causes a status string to be displayed in the 

prompt/status display plane 1 10. This status is displayed until it either times 
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out per the passed time-out value, is cleared by the CM, or another prompt is 
sent. If the prompt string is active, this string is superseded. A user is able to 
check the status of multiple calls at the same time. 



Parameter 


Description 


status IStrmg 


1 his is null-terminated character strmg that is to be displayed. 


Status i ime-out 


1 his determines the number ot seconds that the prompt is to be 
displayed. A value of zero disables the time-out. 


instance Number 


1 his indicates which Line/Call plane tor which we are 
changing key mapping. 


Call Reterence Number 


1 his indicates which call within the Call plane tor which we 
are changing key mapping. 



Ci 5 Clear Status 

't; This message causes the status string which is currently being 

5f displayed to be deactivated. If there is no active prompt string, then the 

4: prompt/status plane is blank. A user can check the status of multiple calls at 

4- the same time since each call has its own status string. This message has two 

O 10 parameters. 



Parameter 


Description 


Instance Number 


1 his indicates which Line/Call plane tor which we are 
changing key mapping. 


Call Reterence Number 


1 his indicates which call within the Call plane tor which we 
are changing key mapping. 



Display Prompt 

This message causes a prompt to be displayed in the prompt/status 
15 display plane. This prompt is displayed until it either times out per the passed 
time-out value, is cleared by the CM, or another prompt is sent. This prompt 
string supersedes the active status string if there is one. 



Parameter 


Description 


Prompt String 


1 his is null-terminated character string that is to be displayed. 
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Prompt l ime-out 



1 his determines the number ot seconds that the prompt is to be 
displayed. A value of zero disables the time-out. 



10 



15 



20 



Clear Prompt 

This message causes the prompt string currently displayed to be 
deactivated. If there is a status message currently active, then it is 
(re)displayed in the prompt/status plane. If not, then the plane is blanked. This 
message has no parameters. 

Active Call Plane 

This message activates the call plane, which displays detailed 

information about calls that are active on the specified line key. 



Parameter 


Description 


Line Instance Number 


Which DN line that is to be detailed in the call plane. 



25 



Deactivate Call Plane 

This message deactivates a call plane. It uncovers the line plane, which 

displays overview call information about the direct number lines to the right 

of the display. This message has no parameters. 

The line handler object is supported by an event message referred to as 
a soft key event. The phone sends this event message to the line handler 
object when the user presses a soft key button. An instance number within the 
soft key button template indicates with which direct line number the event is 
associated. It also contains a reference number indicating with which item in 
the soft key plane the selected soft key is associated. In the described 
embodiment, this message is generic and can be used by other modes within 
the phone, such as the Directory or Messages modes. 

As described above, associated with the line handler object are 
multiple sets of soft keys, presented to the user in the soft key plane based on 
a set of rules observed by the line handler object. The line handler object, as 
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well as each active call in the call plane, has an index which points to the 
plane's currently active set of soft keys. Each soft key index also has a valid 
mask that indicates which keys within the set are vaHd in the current context. 
The Call Meinager changes these iildexes and masks during various phases of 
the calls that are active on the phone. 

A call plane is activated in one of several ways. For example, a call 
plane is activated when the user presses a line key button when the user 
answers a ringing call using the handset, speaker phone, or the "Answer" soft 
key in the soft key plane. In other examples, the call manager activates a call 
plcme when the user originates a new call with the handset, the speaker phone 
key, or the "New Call" soft key in the soft key plane. In another example, the 
phone itself determines when to activate a call plane. It will do this when the 
phone is idle and the phone rings, thereby saving the user the step of having to 
press a key when the phone rings and the user is not using the phone. When 
the user terminates a call, the call manager instructs the phone to de-activate 
the call plane. In the described embodiment, the call manager is not aware 
which call planes aie open and in most cases is not signaled when the user 
presses the line key buttons. The one notable exception to this is when the 
user presses a line key to originate a new call. 

Although the foregoing invention has been described in some detail for 
purposes of clarity of understanding, it will be apparent that certain changes 
and modifications may be practiced within the scope of the appended claims. 
Furthermore, it should be noted that there are alternative ways of displaying 
and allowing a user to navigate through the interactive user interface of the 
present invention. For example, the particular options and features available 
in the various modes can be presented in a different order to a user, i.e. have 
an alternative menu hierarchy, or fewer or additional features and options can 
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be presented to a user without deviating from the general framework of the 
user interface. In another example, other network protocols can be used to 
deliver data to the telephone and, thus, the services and settings modes can 
display data items other than those "shown. Accordingly, the present 
embodiments are to be considered as illustrative and not restrictive, and the 
invention is not to be limited to the details given herein, but may be modified 
within the scope and equivalents of the appended claims. 
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